[QEff. Finetuning]: Adding tests for PP in HF trainer stack#817
[QEff. Finetuning]: Adding tests for PP in HF trainer stack#817quic-swatia wants to merge 3 commits intoquic:ft_experimentalfrom
Conversation
Signed-off-by: Swati Allabadi <sallabad@qti.qualcomm.com>
quic-swatia
requested review from
ochougul,
quic-amitraj,
quic-hemagnih and
quic-rishinr
as code owners
quic-akuruvil
left a comment
quic-akuruvil
left a comment
There was a problem hiding this comment.
Please correct lint error
QEfficient/finetune/experimental/tests/test_pipeline_parallelism.py
Outdated
Show resolved
Hide resolved
quic-akuruvil
left a comment
quic-akuruvil
left a comment
There was a problem hiding this comment.
All these test cases are passing locally?
quic-akuruvil
left a comment
quic-akuruvil
left a comment
There was a problem hiding this comment.
test cases looks good, with extensive coverage.
QEfficient/finetune/experimental/tests/test_pipeline_parallelism.py
Outdated
Show resolved
Hide resolved
There was a problem hiding this comment.
QAIC_VISIBLE_DEVICES=0 python -m pytest QEfficient/finetune/experimental/tests/
Currently this is how we run the existing tests. So based on this mention how to run PP tests. Include sample commands too, in docs
Ideally all tests in the project should run when above command is executed. So lets keep it like that
Signed-off-by: Swati Allabadi <sallabad@qti.qualcomm.com>
yes, all of them are passing locally. |
2 tests in this file requires # visible devices =2. If 1 is passed, it skips those 2 tests. These two tests run even when QAIC_VISIBLE_DEVICES is not mentioned at all and the machine has >=2 devices. |
Signed-off-by: Swati Allabadi <sallabad@qti.qualcomm.com>
|
These changes are added in PR #893. |
3 participants
No description provided.